陳紹慶
慈濟大學人類發展與心理學系專任副教授
開放科學中心大使
心理科學加速器創始成員;訓練委員會助理監督
scchen.com
閱讀句子的心像模擬歷程
Orientation Stanfield & Zwaan (2001)
retrieved from Bergen (2012)
Shape Zwaan, Stanfield, & Yaxley (2002)
retrieved from Bergen (2012)
Color Connell(2005, 2007)
retrieved from Bergen (2012)
潛在應用:人類語言的圖像式處理
Q1:你認為這樣的研究渉及捏造(fabrication)與篡改(falsification)嗎?
Exposed by 3 junior researchers
Investigated by 3 universities
58 papers retracted
10 PhD dissertations were polluted
Faking Science Free for public
What we can learn from Stapel’s career: From questionable research practices (QRPs) to facking data.
Started to develope GRIM test
Source: https://youtu.be/42QuXLucH3Q
Source: https://youtu.be/42QuXLucH3Q
JPSP rejected failed replication(Ritchie, Wiseman, & French, 2012)
HARKing (Hypothesizing After the Results are Known; Kerr, 1998)
(Wicherts et al., 2016)
Q1:操作有疑問的研究都是涉及捏造與篡改嗎?
Q2:經不起考驗的研究結果會傷害研究誠信嗎?
預先註冊(Preregistration):第一階段沒有同儕評審
註冊報告(Registered Report):第一階段有同儕評審
註冊再現研究(Registered Replication Report)
(Lindsay, Simons, & Lilienfeld, 2016)
The researcher creates as detailed a description of his or her plans for a study as possible and saves those plans in a time-stamped, uneditable archive. This record can be shared with reviewers, editors, and other researchers.
My understanding: Preregistration and registered report in social science follow the framework of Randomized Controlled Trial but make a space for researcher flexibility.
Open-Ended Registration
OSF-Standard Pre-Data Collection Registration
AsPredicated registration
Prereg Challenge
How to select my preregistration?
| Information before Study | Suggestion |
|---|---|
| Theory without prediction, No data | Nothing for preregistration |
| Theory without prediction, Pilot showed some things | Open-End |
| Theory with prediction, Pilot supported predictions | OSF-standard |
| Theory with prediction, EXP confirmed predictions | AsPredicted, Prereg challenge |
Pilot: Study without sample size justification; Secondary data set EXP: Study with sample size justification
AIMS Neuroscience submission pipeline
(Chambers, Feredoes, Muthukumaraswamy, & Etchells, 2014)
Daniel Simons on Pre-registration (from “Improving your statistical inferences”)
When publication bias joined:
| Publish rate of negative results | Presented positive rate |
|---|---|
| 10% | 0.84 |
| 20% | 0.72 |
| 60% | 0.47 |
| 80% | 0.4 |
| 90% | 0.37 |
(Fanelli, 2010)
Psychological science should emphasize findings that are robust, replicable, and generalizable.
Direct replications are necessary to estimate the true size of an effect.
Well-designed replication studies should be published regardless of the size of the effect or statistical significance of the result.
Ego depletion
Hagger, Chatzisarantis et al. (2016)
Facial Feedback Effect
Wagenmakers, Beek, Dijkhoff, Gronau et al. (2016)
Q3:我該不該改進研究操作?
Q4:我要從什麼地方開始改進?
Take two minutes, you will…
| Boost self-confidence |
|---|
| Intention to take risks |
| More Testosterone |
| Less Cortisone |
Good theory, Bad evidence
Take two minutes, you will…
| Boost self-confidence | reproducible, postural feedback effect |
|---|---|
| Intention to take risks | unreproducible |
| More Testosterone | unreproducible |
| Less Cortisone | unreproducible |
如果只看正面證據
Wansink boasted how to make paper by QRPs
(Original date: 2016/11/21)
GRIM: A tool to check the spooky roundings.
| James Heathers | Nick Brown | Jordan Anaya | Tim van der Zee |
All 4 Wansink-boasted papers have QRPs:
Questions in Smater Lunchrooms
Brian Wansink is on his position till this talk.
Codes of Conduct for Good Academic Practice
TU/E ERB statement:
Evaluation tools of data quality
(LeBel, vanpaemel, McCarthy, Earp, & Elson, 2017)
Ego depletion (Recommended browser: Firefox)
Q5:公開資料對我有何好處?
Q6:要如何公開資料才能提昇研究品質?
Many Labs project
CRSP special issue(2017): power posing
| Feeling of power: all partiipants | Feeling of power: unfamiliar only |
|---|---|
Code of Conduct
The Society for the Improvement of Psychological Science (SIPS) holds professional conferences and other events to enable its members to work to improve methods and practices in psychological science, build professional networks, and receive continuing education.
Initilized in 2016 (SIPS 1st year)
Register what you Need and what you Have.
After you signed in PSA …
Providing feedback on the procedures, policies, and governance of the Accelerator
Check PSA introductory paper
Each participating lab takes the research ethic approval respectively.
If I have more time, I’d like to share more about PSA and colloborative projects.
自由提問